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AN EXPERIMENTAL STUDY OF PUNISHMENT 


I. INTRODUCTION 


THE SETTING‘ 


it Is a matter of everyday observation 
that a response which is followed by 
a disturbing or traumatic stimulus will 
tend to be weakened in strength and to 
be less likely to occur on subsequent oc- 
casions. In his original formulation of 
the law of effect, Thorndike stated that 
an annoying after-effect exerts a weaken- 
ing effect upon the punished stimulus- 
response connection. As a general de- 
scriptive principle, this statement has 
never been seriously questioned. Most 
experimenters have found that punish- 
ment for ‘errors’ in learning situations 
tends to improve performance (1, 2, 4, 
10, 11, 12, 13, 14, 15, 28, 35, 39) 54) 55, 
56, 57, 59). Likewise, in the classical con- 
ditioning situation, it has been shown 
that a conditioned response is weakened 
by punishment (5). 

Although the general tendency for 
punishment to weaken a response has 
been clearly established, the specific 
mechanism through which it acts has 
been a matter of dispute for more than 
a decade. As a result of a long series of 
experiments, Thorndike has revised his 
original formulation, and now believes 
that an annoying after-effect of a con- 
nection does not exert a direct weaken- 
ing effect comparable to the strengthen- 
ing effect of a reward; when a response 
appears to have been weakened by pun- 
ishment, it is only because the organism 
has been forced to learn some alternative 
response to the situation (50). Unfortu- 
nately, however, the evidence on which 


* This monograph is a revision of a doctoral 
dissertation submitted to the graduate faculty 
of the University of Minnesota in June, 1943. 


Thorndike has based this conclusion is 
not unequivocal; he has generally used 
very mild ‘punishments’ (frequently mere 
lack of reward) and has dealt only with 
complex situations invoking many alter- 
native responses. Although ‘Thorndike’s 
revised formulation has been generally 
accepted, several recent investigators 
have produced evidence favoring the 
original law of effect (6, 8, 43, 45). Hil- 
gard and Marquis summarize the present 
status of the problem as follows: 


The action of punishment is a subject 
urgently needing additional research. It is 
not clear at present whether inhibition by 
punishment can be accounted for in terms 
of interference from responses established by 
the noxious stimulus or whether it represents 
a different and independent form of inhibi- 
tion (25, p. 126). 


THE PROBLEM 

The first question to be investigated 
in the present study will be the effects 
of punishment upon the dynamic prop- 
erties of the punished response. As we 
have already noted, it is well known that 
a response can be weakened in strength 
as a result of an annoying after-effect 
regardless of the specific mechanisms in- 
volved. But it remains to be determined 
whether the weakened response is actu- 
ally eliminated from the organism's 
repertoire by punishment, or merely sup- 
pressed and capable of being released at 
its full original strength after punish- 
ment is discontinued. An exploratory 
investigation of negative reinforcement 
reported by Skinner (42) favors the latter 
possibility. And the clinical psychologist 
has long been aware of the significance 
of behavior which is prevented from oc- 
curring overtly (‘repressed’) because of 


x 
J 
J 
~ 
~ 
a 
- 


2 WILLIAM K. ESTES 


its consequences, but which continued to 
exist in the organism’s repertoire at a 
considerable state of strength. A number 
of the experiments which will be re- 
ported on the following pages deal with 
the changes in strength of a single iso- 
lated response produced by various com- 
binations of positive and negative after- 
effects. 

In the second portion of the investi- 
gation we shall be concerned with the 
clarification of the mechanism of action 
of punishment by means of an experi- 
mental analysis of the functional inter- 
relationships of the variables operating 
in situations involving punishment. 

After the derivation of the empirical 
principles governing the action of pun- 
ishment upon a single response, an at- 
tempt will be made to determine whether 
additional principles will be required to 
account for the effects of punishment in 
more complex situations. 


A NOTE ON METHOD 


The results of an experiment can be 
evaluated only in the light of the meas- 
ures which have been taken to ensure 
functional isolation of the variables un- 
der consideration. The only completely 
satisfactory method of achieving such iso- 
lation is control of irrelevant variables. 
However, psychologists have frequently 
been unable to secure satisfactory con- 
trol of experimental conditions and have 
resorted to the use of large numbers of 
subjects in the hope that the effects of 
uncontrolled factors would tend to aver- 
age out. In the present study it has been 
necessary for several reasons to rely prin- 
cipally upon experimental control. It ap- 
peared likely that many important quan- 
titative properties of punishment would 
be revealed only under conditions of 
rigorous experimental isolation of the 
behavior studied. And in order to in- 


vestigate the relatively permanent effects 
of punishment under varying conditions 
it was necessary to obtain a large num- 
ber of responses from each subject over 
a considerable period of time, a proce- 
dure which was for practical reasons in- 
compatible with the use of a large num- 
ber of subjects. 

In addition to the techniques of ex- 
perimental control, which will be de- 
scribed in detail later, the general design 
of the investigation and the statistical 
analysis of the data are pertinent to an 
evaluation of the results. The various 
experiments described are “interlocking” 
in character, so that nearly every conclu- 
sion drawn from the entire study is sup- 
ported by the results of at least two dif- 
ferent experiments. Wherever feasible, 
Statistical tests of significance, usually 
Student’s “t” test, have been applied. It 
has been assumed that whenever the 
probability attaching to the value of “t” 
yielded by two sets of measures is less 
than 0.05 the possibility that the ob- 
served difference is due solely to sampling 
errors can be safely disregarded. 


SUBJECTS AND APPARATUS 


The subjects in all of the experiments 
to be reported were albino rats from the 
Minnesota laboratory stock. ‘The groups 
of animals used in different experiments 
varied somewhat with respect to age, sex, 
and genetic history. Within each experi- 
ment, however, the experimental and 
control groups have been equated with 
respect to all of these factors. 

The apparatus used has been described 
in detail by Heron and Skinner (24). 
During each experimental period each 
rat was enclosed in a light-proof and 
nearly sound-proof box containing a re- 
tractable lever which could easily be de- 
pressed and a magazine which could be 
set to reinforce responses to the lever by 
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releasing small (0.05 gr.) pellets of food 
into a food tray at one end of the box. 
A curve, number of responses vs. time, 
was recorded kymographically for each 
rat. An electric shock, the “punishment” 
in these experiments, could be delivered 
by a condensor through the wire grid 
which formed the floor of the experi- 
mental cage. The duration of the shock 
was but a fraction of a second. The tone 
used in one experiment was produced 
by phones attached to a sixty cycle AC 
transformer. 


GENERAL PROCEDURE 


While on an experimental routine, the 
animals were always fed dry Purina dog 
food for one hour immediately after the 
day’s experimental session. Experimental 
periods were one hour long except where 
otherwise specified. Water was available 
in the living cages at all times. It was 
not possible to control the temperature 
of the living quarters completely; there- 
fore comparisons of results of different 
experiments have been made only in 
cases where temperature variations could 
safely be assumed to be inconsequential. 

The lever-pressing response is rou- 
tinely: conditioned under the following 
procedure. The rat is first placed in the 
experimental box for a one-hour period 
during which food pellets are periodi- 
cally released by the magazine and the 
rat learns to respond promptly to the 
click of the magazine by approaching 
the food tray and seizing the pellet. On 
the day of conditioning, the rat is again 
placed in the box; the lever is now pres- 
ent and connected with the magazine so 
that responses to the lever will be rein- 
forced with food. When, in the course 
of exploratory activity, the rat “acci- 


dentally” moves the lever, a pellet of 
food is released into the food-tray, and 
typically the rat soon comes to respond 
at a constant rate. It should be noted 
that any movement which results in de- 
pression of the lever counts as a response. 
Most rats form the habit of rising and 
striking the lever with the fore-paws. 

After preliminary conditioning, each 
rat was given several hours of periodic 
reinforcement before being used in an 
experiment. Under this procedure, a con- 
trol clock is set to reinforce single re- 
sponses to the lever every four minutes, 
intervening responses going unrein- 
forced. Except where specified otherwise, 
the preliminary training of all rats used 
in the following experiments consisted of 
initial conditioning and two or three 
hours of periodic reinforcement (just 
enough to produce a stable rate of re- 
sponding). 


SYMBOLIC NOTATION 


The following notation will be used 
throughout the paper. R, response; S, 
stimulus; S$”, discriminative stimulus; S®, 
reinforcing stimulus; S?, disturbing or 
traumatic stimulus; Xe mean number of 
responses for experimental group during 


a given period; xg, mean number of re- 
sponses for control group during a given 
period; “‘t’, Student’s “t-ratio”, ie., the 
ratio of a mean difference to an esti- 
mate of its standard error; P,, the prob- 
ability that a value of “t” as large as that 
observed would occur in a random sam- 
pling distribution; N, number of sub- 
jects; Pr., periodic rate (in terms of num- 
ber of responses per hour); T, ,, total 
number of responses during the first x 
experimental periods. 
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II. BAstc EXPERIMENTS 


uTsibE of the laboratory, punish- 

ment occurs in two general types 
of situation. In the first, the punishment 
results mechanically from every occur- 
rence of the response during the lifetime 
of the organism (e.g., the negative rein- 
forcement produced by touching a hot 
radiator). In the second, punishment is 
administered, usually through the media- 
tion of another organism, for making 
some specific response during a limited 
period of time (e.g., punishment of a 
child for going into the street). Since the 
former situation involves no_ peculiar 
theoretical problems, only the latter, and 
probably more general, case will be sub- 
jected to experimental study. 

In the practical control of behavior, 
reward is usually discontinued when 
punishment is administered; however, in 
some instances, this is difficult or impos- 
sible (e.g., in the punishment of crimi- 
nals), so both conditions will be con- 
sidered in this chapter. 


SECTION 1. THE EFFECTS OF VARYING 
CONDITIONS OF PUNISHMENT OF A 
RESPONSE UPON THE COURSE OF 
SUBSEQUENT EXTINCTION 

The experiments to be described in 
this section were designed to provide at 
least partial answers to these questions: 

1. What are the effects of punishing a 


response upon the course of subsequent ex- 
tinction? 


2. To what extent are these effects a func- 
tion of the conditions of punishment and 
the initial strength of the response? 

In the first situation to be considered, 
a response which was previously posi- 
tively reinforced is punished during a 
limited period of time, then during sub- 
sequent periods is neither punished nor 
reinforced. Some of the problems which 
arise are illustrated by the diagram in 


Figure 1. Let us assume that two groups 
of animals have been positively rein- 
forced for emitting some specific response 
and that they have attained equal mean 
rates of responding under periodic rein- 
forcement as shown on Day 1 in Figure 1. 
Then, beginning on the following day, 
reinforcement is discontinued for the 
control group and all responses go un- 
reinforced thereafter. Skinner’s studies 
(42) show that the rate of responding 


RESPONSES 
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Fic. 1. Paradigm of possible effects of a single 
period of punishment upon the course of sub- 
sequent extinction. 


during subsequent periods will decline 
regularly for this group in a negatively 
accelerated curve and will continue to 
decline until a permanently low rate 
(slightly above zero) is reached and the 
response is said to be extinguished. ‘That 
is, effectively it is no longer a part of the 
organism’s repertoire. 
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Now let us turn to the experimental 
group. On Day 2 (Figure 1) the experi- 
mental animals are severely punished for 
each response and the rate quickly falls 
to nearly zero. Superficially, it appears 
that by the use of punishment a state of 
extinction of the response has been 
reached in one day which required more 
than eight days for the control group 
under conditions of simple non-reinforce- 
ment. But in the case of the experimental 
group is the strength of the response at 
the end of Day 2 a reliable index of the 
true state of its dynamic properties? That 
is, if these rats are returned to the situa- 
tion on subsequent days as were those 
of the control group, will the rate of 
responding (1) continue at a low value; 
(2) rise immediately after the termina- 
tion of punishment to the rate which 
would have obtained if no punishment 
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had been administered; (3) recover grad- 
ually on subsequent days until at some 
later point the curve rejoins that of the 
control group; or (4) during recovery 
rise above the rate of the controls for a 
time so that the total number of re- 
sponses occurring during extinction is 
equal to that which would have appeared 
if no punishment had been adminis- 
tered? 

Only if alternative (1) proves to be 
correct will we be able to conclude that 
punishment accelerates the process of ex- 
tinction of a response from an organism's 
repertoire. Any other result will indicate 
that punishment results in a suppression 
rather than an elimination of behavior. 
The other possible continuations do not 
affect the total amount of time required 
for extinction, and differ among them- 
selves chiefly in the extent of reduction 
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Fic. 2. Effects of a short period of mild punishment upon extinction. Punishment was administered 
to the experimental rats from the fifth to the twentieth minute of Period 1. The left hand panel 
shows the mean periodic rates and extinction records in terms of the raw data; in the right hand 
panel the mean extinction curves have been corrected for differences in periodic rate and plotted 


cumulatively (Experiment A). 
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in the total number of elicitations of 
the response necessary for extinction. 


Experiment A. Effects of Mild Punish- 
ment upon Extinction 


Throughout the present study, the 
severity, or intensity, of the punishment 
is judged by its momentary effect upon 
the animal’s behavior. In the present 
stage of our knowledge, physical meas- 
ures of the intensity of a negatively rein- 
forcing stimulus have relatively little 
psychological meaning. Two widely sep- 
arated intensities of shock are studied in 
this investigation. The ‘mild’ punish- 
ment is a shock just strong enough to 
produce a reliable depression in the rate 
of responding and not strong enough to 
produce complete inhibition of the re- 
sponse, even when continued for an hour 
or more. The ‘severe’ punishment is a 
shock which results in a decline in rate 
of responding to virtually zero within a 
few minutes. The following’ experiment 
investigates the effects of a short period 
(15 minutes) of mild punishment. 

Subjects and Procedure. The subjects, 
sixteen male rats, were divided into an 
experimental and a control group of 
eight rats each after preliminary condi- 
tioning and periodic reinforcement. On 
the first day of the experiment proper, 
both groups received one hour of extinc- 
tion of the pressing response. From the 
fifth through the twentieth minutes of 
this period, the experimental animals 
were punished for responding. The con- 
densors were connected in circuit with 
the levers and the grid floor of the ex- 
perimental boxes so that when the con- 
densors were set, depression of the lever 
released a shock through the grid. Dur- 
ing the fifteen-minute period of punish- 
ment, the shocking apparatus was reset 
every thirty seconds. Thus, not all re- 
sponses were punished, but many were. 


A second hour of extinction without pun- 
ishment was given both groups twenty- 
four hours after the first and a third 
forty-eight hours after the second. 
Results. The course of the experiment 
is shown graphically in the left hand 
panel of Figure 2, and the quantitative 
results are summarized in Table 1. It 


TABLE 1 


Mean periodic rates and extinction 
records for Experiment A 


Extinction Periods 


PY. 
2 3 
¥p 308 181 99 145 425 
Xc 264 198 97 67 362 
t -34 .06 3.02 
Py .72 .OI 


* During the fifteen-minute interval of punish- 
ment in Period 1, the mean number of responses 
for the experimental group was 45, of which 9.25 
were punished; the corresponding value for the 
control group was 58 responses. 


will be noted that the experimental rats 
had a somewhat higher mean _ periodic 
rate than the controls. . 

The immediate effect of the shock was 
a gradual decrease in rate of respond- 
ing. By the end of the interval of punish- 
ment, the rate for the experimental rats 
had dropped considerably below that of 
the controls. After termination of the 
shock, the strength of the response began 
to recover within a few minutes, and by 
the end of the hour was about equal to 
that of the controls. These effects are 
illustrated by a mechanically averaged 
kymograph record for four of the ex- 
perimental rats reproduced in Figure ga. 
The two groups produced about the 
same numbers of responses on the second 
day of extinction; on the third day the 
experimentals exceeded the controls by 
an amount sufficient to compensate fully 
for the deficit incurred on the day of 
punishment. 
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The higher periodic rate of the experi- 
mental rats indicates that they probably 
had a slightly higher average motiva- 
tional level than the controls. In order 
to gain a more accurate estimate of the 
extent of compensation for the tem- 
porarily depressing effect of punishment, 
the extinction record for the experi- 
mental group has been multiplied 
through by a constant chosen to equate 
the groups for initial periodic rate and 


plotted as a cumulative curve, along with . 


the corresponding control record, in the 
right hand panel of Figure 2. A compari- 
son of the corrected curves for the two 
groups indicates that for the condition 
of punishment used in this experiment, 
the course of subsequent extinction is 
correctly described by Curve (4) in Fig- 
ure 1. This result strikingly confirms an 
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Fic. 2a. Reproduced from photostatic copies of 
mechanically averaged kymograph records of 
four experimental and four control rats for Pe- 
riod 1. The interval during which the experi- 
mental animals were punished is_ indicated 
(Experiment A). 


experiment reported by Skinner (42). 
Skinner found that a short period of 
mild punishment (consisting of a slap 
administered to the rat’s forepaws by a 


“kick-back” of the lever) resulted in a 
temporary depression in rate of respond- 
ing followed later by complete compen- 
sation. 

Conclusion, The effect of a short pe- 
riod of mild punishment is a temporary 
depression in rate of responding, fol- 
lowed later by a compensatory increase 
in rate such that the total number of 
elicitations of the response necessary for 
complete extinction is equal to that 
which would have been required if no 
punishment had been administered. 


Experiment B. Effects of a Short 
Period of Severe Punishment upon Ex- 
tinction 

The interval of punishment used in 
this experiment was just long enough to 
allow the mean rate of responding of the 
punished animals to drop to virtually 
zero. Judged by its effect upon the mo- 
mentary behavior of the rats, the shock 
was distinctly more severe than that used 
in Experiment A. This intensity was held 
constant throughout the remainder of 
the investigation, since it appeared that 
important properties of punishment 
would be revealed more clearly at high 
intensities. 

Subjects and Procedures. Nineteen rats 
were subdivided as follows after prelimi- 
nary training: 


Group N 
Part 1 
A (Experimental) 5 
B (Control) 5 
Part 2 
C (Experimental) 5 
D (Control) 4 


In the present discussion, the two parts 
of the experiment will be treated as es- 
sentially two replications of the same ex- 
periment. The significance of a minor 
difference in procedure on the day of 
punishment will be taken up in the next 
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TABLE 2 


Mean number of responses per experimental period under conditions of periodic 
reinforcement, punishment, and extinction (Experiment B) 


Extinction Periods 


N Pr. Pun. 
I 2 3 4 5 6 
Part 1 
XA 5 336.6 15.8 115.2 103.2 QgI.o 57.0 60.6 51.0 
kp 5 365.0 76.4 207.6 124.4 102.6 63.0 43.8 42.6 
t 4.10 2.14 .51 -30 .24 -65 
Py .003 .O7 .64 .82 -49 
Part 2 
ic 5 260.9 20.0 79.4 66.6 58.6 28.0 32.2 32.2 
ip 4 196.6 70.8 133-3 78.5 58.8 61.0 43.8 37.8 
t 1.47 1.29 -43 -OI 1.32 +45 
.18 .24 .68 .40 -57 


section of the paper. On the first day of 
the experiment proper, all four groups 
were placed in the boxes for a ten-minute 
period? during which they were subjected 
to the following procedures: 


?Preliminary experimentation showed that 
with the intensity of shock used a ten-minute in- 
terval of punishment was long enough to pro- 
duce temporary suppression of the responses 
in all cases but not long enough to permit any 
perceptible recovery from the initial effect. 


Group A: Punishment of all responses in 
addition to continued periodic food rein- 
forcement 

Group B: Periodic food reinforcement 

Group C: Extinction with all responses 
punished 

Group D: Extinction. 


From the second through the seventh 
day of the experiment, all four groups 
were returned to the boxes daily for one- 
hour periods of simple extinction. 


° PART | PART 2 
330° 
oD 10 MIN. EXT 
ec 10 MIN. EXT.+ PUN 
LJ 
° 
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Fic. 3. Effects of a short period of severe punishment upon extinction. The initial depression in rate 
of responding resulting from punishment is followed by gradual recovery until the experimental 
curves rejoin those of the controls (Experiment B). 


AN EXPERIMENTAL STUDY OF PUNISHMENT g 


Results. The results of the experiment 
are summarized in Table 2 and illus- 
trated graphically in Figure 3. The im- 
mediate effect of the punishment was a 
rapid decrease in the rate of responding 
until all of the experimental animals 
had ceased responding entirely by the 
end of the ten-minute period of punish- 
ment. The initial effect is illustrated by 
the individual record for one of the ex- 
perimental rats of Part 2 reproduced in 
Figure ga. It will be noted that the total 
number of responses made by the experi- 
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Fic. 3a. Reproduced from photostatic copies of 
the curves of an experimental and a control 
rat on the day of punishment (Experiment B, 
Part 2). 


mental rats was only a small fraction of 
the number produced by the controls 
during this period. On the first subse- 
quent day of extinction, the rate of re- 
sponding of the experimental animals 
was still markedly depressed. By the 
fourth day, however, the momentary 
strength of response for the experimen- 
tals was approximately equal to that of 
the controls. During the last three days 
of extinction, the experimental and con- 
trol groups did not differ significantly. 
Although both experimental curves ex- 
hibit slight compensatory increases dur- 
ing the latter stages of extinction, com- 
pensation is by no means complete, and 
the total heights of the experimental 


curves are somewhat reduced as com- 
pared to the control records. ‘The general 
picture corresponds to Curve (3) of Fig- 
ure 1. 

The close agreement of the two parts 
of the experiment with respect to the 


course of recovery from punishment sug- 


gests that the form of the process may 
be well enough established by these data 
to permit a mathematical description. 

Let us take as a convenient index of 
the effect of punishment during any 
given extinction period the difference 
between the heights of the experimental 
and control curves, expressed as a pro- 
portion of the latter. That is, 


Xo — Xz 
Although this index is not entirely satis- 
factory, it is probably the best one avail- 
able at present. It is to be expected that 
the extent to which a mathematical anal- 
ysis of the effects of punishment can be 
fruitfully carried will be limited until 
an extensive mathematical treatment of 
conditioning and extinction has been 
completed. The observed values of p for 
the two parts of the experiment are 
plotted against time in Figure 4. 

Choice of a simple mathematical func- 
tion to describe the recovery process must 
be guided by several known conditions 
in addition to the trend of the empirical 
points in Figure 4. + 


1. The form of the recovery process is, in 
part, a function of the severity of punish- 
ment (Experiments A and B). 

2. Recovery is affected by individual dif- 
ferences in constitutional “reactivity” or 
“sensitivity” to the punishing stimulus (ob- 
served in all of these experiments). 

3. The rate of recovery is probably a func- 
tion, in part, of the amount of positive 
reinforcement of the response prior to the 
period of punishment (for experimental con- 
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firmation of this assumption see Experiment 
F). 

Unfortunately, it is not yet possible to 
obtain independent quantitative esti- 
mates of the effects of these factors upon 
the rate of recovery. However, their ef- 
fects can be taken into account by in- 
corporating into the equation a measure 
of the initial effect of punishment which 
is in turn a joint function of these fac- 
tors. 


PART 2 
X= OBSERVED VALUES 
- 50 ®= CALCULATED VALUES 
a PART | 
L75 
ath X = OBSERVED VALUES 
= CALCULATED VALUES 
© 
=> 
x 
PUN. 
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Fic. 4. The course of recovery from the depress- 
ing effect of a short period of severe punishment, 
including both theoretical and observed values 
of p, an index of the current effect of punish- 
ment (Experiment B). 


A simple function which meets the 
above-mentioned conditions is an equa- 
tion of the form 


= (A) 
where P, is the value of p for the period 
during which punishment is adminis- 
tered, t is a measure of time in terms of 


the number of periods of exposure to 

the situation in which the punishment 

was administered, e is the base of Na- 

perian logarithms, and a is a constant. 
A curve of this form in which 


Po = 9.7932 

a = 0.6772 
has been fitted to the first four empirical 
values of p for Part 1 of the experiment 
in the lower panel of Figure 4. The func- 
tion chosen is evidently descriptive of the 

trend of observed points. 

A preliminary test of predictive sig- 
nificance of this function is afforded by 
Part 2 of the experiment, since, by means 
of the equation, it should be possible in 
the case of other experiments carried out 
under conditions similar to those of the 
original to predict the course of recovery 
from punishment if a measure of the 
initial effect of the punishment is avail- 
able. The theoretical curve in the up- 
per panel of Figure 4 represents an equa- 
tion of the same form as equation (A), 
in which the value of the constant of 
decrement, a, is taken from the curve of 
Part 1. It will be observed that the pre- 
dicted and observed values of p for Part 
2 of the experiment are in fair agree- 
ment, especially considering the small 
number of subjects used. The empirical 
points have not been plotted beyond the 
point at which the difference between 
experimental and control groups once 
reaches zero in either case. The extinc- 
tion curves become so low by the third 
or fourth day that for small groups of 
animals the observed values of p must 
become very unreliable beyond this 
point. 

Equation (A) is to be treated as an 
empirical rather than a rational equa- 
tion. It will be possible in later experi- 
ments, however, to test the descriptive 
power of this function beyond the limits 


AN 


of the data upon which it was based. It 
will be noted, for example, that accord- 
ing to Equation (A), recovery from the 
effects of punishment is never quite com- 
pleted. With increasing time, the magni- 
tude of p approaches zero asymptotically. 
It is impossible to confirm or refute this 
property of the equation in the present 
experiment since the effect remaining 
after three or four periods of extinction 
is so small as to be obscured by “chance’”’ 
fluctuations. In Experiment C, in which 
the period of punishment is of consider- 
ably greater duration, it may be possible 
to test this implication of the equation, 
since the relatively permanent effect of 
punishment should in that case be large 
enough to be detectable under suitable 
conditions. 

Conclusion, It appears that under the 


conditions of the present experiment, 
namely: 


(a) that a response has been raised to a 
relatively high state of strength by periodic 
reinforcement; and 


(b) that punishment is administered for a 
period of time just long enough to produce 
temporary suppression of the response; 


the process of recovery from the effect of 
the punishment during subsequent pe- 
riods in which the response is neither 
punished nor rewarded is described by 
the equation 


Pt = 


where p, is an index of the effect of pun- 
ishment remaining at time t, p, is a 
measure of the initial effect of the pun- 
ishment, and a is an arbitrary constant. 
It is probable that, under the condi- 
tions stated, the process of recovery from 
punishment will always proceed more 
rapidly than extinction of the response; 
therefore the effects of punishment wil 
be almost completely dispelled at so 
point prior to the time at which extinc- 
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tion would have been completed in the 
absence of punishment. Subsequent to 
this point, the strength of the response 
will equal or exceed that which would 
have obtained if no punishment had 
been administered. The total amount of 
time required for complete extinction of 
the response will not, then be affected 
by the punishment, irrespective of its 
severity, although the number of elicita- 
tions of the response necessary for ex- 
tinction may be reduced somewhat. 


Experiment C. Effects of Prolonged 
Punishment upon Extinction 

In Experiment B, the punishment was 
continued only until the rate of respond- 
ing had dropped to approximately zero. 
In the present experiment, the punish- 
ment was carried beyond this point of 
temporary inhibition, so that when the 
response began to recover in strength 
later in the period, it was again pun- 
ished. By the end of a sixty minute pe- 
riod of punishment, it appeared likely 
that the rate of responding would remain 
virtually at zero so long as the correla- 
tion of shock with response was main- 
tained. In the vernacular, the animals 
had learned “that the administration of 
punishment was not merely a temporary 
matter.” 

Subjects and Procedure. Vhe subjects 
for the two parts of the experiment were 
twenty rats subdivided as follows: 


Group N 
Part 1 
A (Experimental) 4 
B (Control) 5 
Part 2 
C (Experimental) 5 
D (Control) 6 


After the usual preliminary training, 
the animals were subjected to the fol- 
lowing procedures. 
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Part 1. On the first day of the experi- 
ment, Group B received one hour of ex- 
tinction while Group A received an hour 
of extinction with all responses punished. 
Subsequently each group received four 
periods of simple extinction. The inter- 
vals between experimental periods were 
varied: between the first and second, one 
day; between the second and third, two 
days; between the third and fourth, four 
days; between the fourth and fifth, twen- 
ty days. 


four groups of animals were recondi- 
tioned’ and given two more days of pe- 
riodic reinforcement followed by three 
days of extinction in order to test for 
any permanent effects of the protracted 
punishment. 

Results. A comparison of the experi- 
mental and control records of Part 1 
(Figure 5 and Table 3) reveals little re- 
covery from the effects of the long period 
of punishment. The extinction curve for 
Group A approaches the form of Curve 
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Fic. 5. Effects of a sixty-minute period of punishment upon extinction. In Part 2, extinction was 
not begun until eight days after the period of punishment, the depressing effect of punishment was 
not dispelled by a mere lapse of time (Experiment G). 


Part 2. On the first day, Group D re- 
ceived simple extinction of all responses 
for one hour, while Group C received an 
hour of extinction with all responses 
punished. Eight days later, both groups 
were returned to the boxes for further 
extinction. The second and third periods 
were separated by one day, the third and 
fourth by twenty days. 

After the last extinction period, all 


(1) in Figure 1. However, the fact that in 
Part 2, where the same amount of pun- 
ishment was used, the experimental curve 
rejoins that of the controls on the fourth 
day, suggests that the recovery process 
in the case of Group A was not entirely 


*During the period of reconditioning each 
animal was reinforced for the first five consecu- 
tive responses emitted, than periodically rein- 
forced for the remainder of the hour. 
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absent, but for some reason was delayed. 
This hypothesis is supported by the re- 
sults of the reconditioning, and second 
extinction. A relatively permanent effect 
of the protracted punishment is indicated 
by the fact that Groups A and C have 
lower periodic rates and smaller extinc- 
tion curves after reconditioning than the 
control groups, although they had ex- 
hibited higher periodic rates prior to the 
period of punishment.* However, during 
the hour of reconditioning after the first 
extinction (see Table 3), the animals of 
Group A averaged a considerably larger 
number of responses than the corre- 
sponding controls, ‘This anomalous find- 
ing suggests that a number of responses 


in part by the temporal spacing of the 
extinction periods, In other experiments 
which involved long periods of punish- 
ment but in which the extinction periods 
were separated only by twenty-four hour 
intervals, recovery was considerably ac- 
celerated (e.g., Experiment F). 

Except for the differences already 
noted, the results of Part 2 of the present 
experiment are similar to those of Part 1. 
The effects of punishment clearly were 
not dispelled by mere lapse of time be- 
tween termination of punishment and 
the beginning of subsequent extinction. 
In fact it appears not unlikely that the 
affect of a lapse of time is to accentuate 
the effect of punishment. 


TABLE 3 


Quantitative data of Experiment C in terms of group means, including number of responses per hour 
during original periodic reinforcement, punishment, and extinction; total number of 
responses during first extinction; number of responses during the hour of 
reconditioning; periodic rate after reconditioning; total number of 

, responses during second extinction 


Rec. 


2.50 
.03 


25 
.24 


14 
.30 


which had been suppressed by the severe 
punishment and which had not recovered 
sufficiently in strength to appear during 
the extinction periods were released 
when reinforcement was re-introduced 
and produced a temporary spurt in rate 
of responding. 

It appears likely that the extreme delay 
in recovery from punishment in this 
experiment may be accounted for at least 


‘This result confirms one implication of the 
equation developed in Experiment B, namely, 
that of a permanent effect of punishment. 


Even with the amount of punishment 
used in this experiment, the strength of 
the response at the end of the period of 
punishment cannot be taken as an index 
of its true state. By the end of the hour 
of continuous punishment, it seemed al- 
most certain that the rate of responding 
would remain very close to zero so long 
as punishment was continued. But dur- 
ing subsequent periods of extinction 
without punishment, the experimental 
animals emitted a substantial number of 
responses, even though the rate was con- 


4 


Pr. I 3 4 5 6 

(Pun.) 

Part 1 = 

XA 453-1 84.8 46.0 47.5 15.8 8.5 5.8 208.4 236.5 140.8 188.8 e: 
ZR 365.4 =222.6 113.0 86.8 51.6 34.4 33-6 542.0 174.0 218.0 235.0 eee 
t 1.41 23.27 5.52 32.8% 2.26 83 1.43 .67 ee 
Pr 20 .O1 .06 .06 .03 .06 43 .19 52 = 
Part 2 

Ko 8457-8 772 29.0 23.2 23.4 152.8 120.2 159.4 189.0 
Xp 378.2 161.5 63.5 63.0 28.2 316.2 239.2 242.9 239.0 ae 
Py -59 .04 .17 17 
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siderably depressed as compared to the 
control record. 

Conclusion. A response which has once 
been strengthened by periodic reinforce- 
ment cannot be eliminated from the 
organism’s repertoire solely through the 
action of punishment. Although extreme 
instances may conceivably be found in 
which this principle breaks down, it is 
now well established for a wide range of 
conditions of punishment. 
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Fic. 6. Effects of several short periods of punish- 
ment. Note the abrupt recovery in strength of 
the response when punishment is discontinued 
(Experiment D). 


Clearly, punishment results in a sup- 
pression rather than a weakening of the 
response. If extinction is carried out 
while the response is depressed in 
strength as a result of prolonged punish- 
ment, a considerable saving may be ef- 
fected in the total number of elicitations 
of the response necessary for extinction. 
However, there_is_no evidence that the 
time required for complete extinction 
can be reduced by the action of punish- 


ment. In cases where punishment has 
apparently accelerated the extinction 
process, the suppressed behavior can still 
be released under suitable conditions. 


Experiment D. Effects of Several 
Short Periods of Severe Punishment 
upon Extinction 

The results of the preceding experi- 
ment suggest that a response cannot be 
eliminated from an organism’s reper- 
toire by a single period of continuous 
punishment irrespective of its duration. 
However, it may be that repeated periods 
of punishment might accomplish what 
one period cannot. The following ex- 
periment was designed to test this pos- 
sibility. 

Subjects and Procedure. After prelim- 
inary training, eight rats were divided 
into an experimental and a control 
group, each including two males and 
two females. On each of the first three 
days of the experiment proper, both 
groups were placed in the experimental 
boxes for a ten-minute period, during 
which the control rats received simple 
extinction while the experimefffal ani- 
mals received extinction plus punish- 
ment for all responses. Both groups were 
given one hour of extinction daily on 
the fourth, fifth, and sixth days of the 
experiment. 

Results. The immediate effects of pun- 
ishment in this experiment (see Figure 
6 and Table 4) are similar to those ob- 
served in Experiment B. During the first 
period of punishment, the rate of re- 
sponding for the experimental group 
dropped to nearly zero, At the beginning 
of cach of the next two periods, the 
strength of the response had “spon- 
taneously” recovered somewhat but 
quickly dropped back to zero when pun- 
ishment was continued. It is apparent 
that so long as punishment continues to 
follow all responses, the rate of respond- 
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ing can be held at a level equal to or 
less than that reached by the controls 


after six days of extinction.> When 


punishment was finally discontinued, 
however, it was again demonstrated that 
punishment had not afforded a means of 
“shortcutting” the extinction process. 
‘The sharp rise in the experimental curve 
on the fourth day might even suggest 
that the action of punishment is gov- 


erned by a law of diminishing returns 


5 


the response required for extinction is 
reduced by this procedure by a number 
equal to the difference between the num- 
ber occurring during the periods of pun- 
ishment and the number which would 
have occurred during those periods un- 
der conditions of simple non-reinforce- 
ment. However, the time required for 
complete extinction is not altered by the 
punishment. 


When a response has once been rein- 


TABLE 4 


Mean number of responses per experimental period under conditions of 
periodic reinforcement, punishment, and extinction (Experiment D) 


Punishment Extinction 
Pr. Tpun. Text. Ti 
I 2 3 5 6 
(10 min. periods) (60 min. periods) 
ip 317.0 8.0 4.3 4-3 69.8 20.8 22.8 16.6 113.4 130.0 
Kc 268.5 3.8 26.3 76.0 37.3 27.3 68.4 140.6 209.0 
t 2.73 3-35 6.03 .20 1.14 . 63 4-34 2.68 1.31 
Pr .04 .OI .OOI .85 «gt .62 .005 .04 .24 


similar to that observed in the case of 
original positive reinforcement (42), and 
that recovery from the initial effect of 
punishment was proceeding concomi- 
tantly with the continued punishment 
during the second and third periods. 
Conclusion. The effect of repeated pe- 
riods of severe punishment is a suppres- 
sion of the response which is maintained 
as long as the punishment continues to 
be correlated with the response. After 
discontinuation of the punishment, the 
strength of the response recovers to an 
extent such that during subsequent pe- 
riods of extinction the rate of responding 
is about equal to that which would have 
obtained at the same time if no punish- 
ment had been administered. The total 
number of unreinforced elicitations of 


5 The true difference between the two groups 
during the periods of punishment is probably 
greater than that indicated by Figure 6, since 
the experimental group had the higher rate un- 
der periodic reinforcement, 


forced, there are definite limits imposed 
by the structure of the organism upon 
the extent to which external agencies 
can control the behavior by supplying or 
withholding punishments and rewards. 
Conditions intrinsic to the organism gov- 
ern the maximum amount of behavior 
which will be available for elicitation 


during any given period of time. By the 


application of punishment, one can mod- 
ify, almost at will, the number of re- 
sponses during any single period of ex- 
posure to the situation in which the re- 
sponse can be made, but the total num- 
ber of such periods necessary for elimi- 


nation of the response cannot be modi- 
fied. 


Experiment E. Effects of Periodic as 
Compared to Continuous Punishment 


of the Response upon the Course of 
Extinction 


Skinner (42) has shown that periodic 
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positive reinforcement of a response pro- 
duces much greater resistance to extinc- 
tion than continuous reinforcement. ‘The 
following experiment was designed to de- 
termine whether a similar principle gov- 
erns the action of punishment. 
Subjects and Procedure. ‘Two groups 
of rats, each including three males and 
two females, received the usual prelim- 
inary training before beginning the ex- 
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Fic. 7. Periodic vs. continuous punishment. The 
corrected curve for Group B, which received 
continuous punishment on Day 1, has been 
multiplied through by a constant chosen to 
equate the two groups with respect to periodic 
rate (Experiment E). 


periment proper. On the first day both 
groups were placed in the experimental 
boxes for a forty minute period, Group 
B receiving punishment for all responses 
while Group A was given periodic pun- 
ishment under the following procedure. 
The period was divided into eight five- 


minute intervals. During the first, fourth, 
and seventh of these intervals, all re- 
sponses were followed by shock, while 
responses occurring during the interven- 
ing intervals were neither punished nor 
reinforced. On the last five days of the 
experiment both groups were given one 
hour of simple extinction daily. 
Results. The results are summarized in 
Figure 7 and Table 5. Clearly the pro- 
cedure of continuous punishment pro- 
duced a more rapid decline in rate of re- 
sponding on the first day than periodic 
punishment, although the average num- 
ber of punished responses was about the 
same for the two groups (Group A, 9.0; 
Group B, 8.5). During the subsequent 
extinction, on the other hand, Group A 
showed somewhat slower recovery. Since 
the two groups differed considerably in 
initial periodic rate, a curve corrected for 
periodic rate is included in Figure 7. 
The difference between groups on the 
first day yields a value of “‘t’”” which would 
be expected about nine times in a hun- 
dred through the operation of chance 
factors. On the remaining days of extinc- 
tion, the trend is consistent although 
none of the individual mean differences 
are statistically reliable. Although the 
difference in the effects of the two con- 
ditions of punishment is not large, the 
observed difference can probably be ac- 
cepted with confidence, since this result 
is confirmed by an independent experi- 
ment which will be reported later (Ex- 
periment K). 
‘Conclusion. Continuous punishment 
produces a greater initial depression in 
strength of the response than periodic 
punishment; however, recovery from the 


effects of periodic punishment is clearly 


no more rapid than recovery from con- 
tinuous punishment, and is probably 
somewhat slower. Again it is observed 


_that the strength of a response at the end 
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of a period of punishment is not a re- 
liable index of its true state, 


Experiment F. Effects of Punishment 
upon Responses which Differ in Initial 
Resistance to Extinction 


In exploring the effects of various con- 
ditions of punishment, we have dealt in 
each instance with behavior which 
existed at a state of considerable strength 
prior to the period of punishment. This 
is the case of most general interest since 
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in the boxes for a forty-minute period 
during which Group B received simple 
extinction, while Groups A and C re- 
ceived extinction plus punishment for 
all responses. On the remaining four days 
of the experiment all groups received 
one-hour periods of extinction. 

Results. Group A, which had received 
only one hour of periodic reinforcement, 
clearly shows a greater initial depression 
in rate of responding during the period 
of punishment and a slower recovery 


TABLE 5 
Mean periodic and extinction records for Experiment E 


Extinction Periods 


N Pr. 
I 3 4 5 6 7 Tez 
(Pun.) 
KA 5 152.6 23.8 15.0 24.8 14.8 20.2 18.6 13.0 106.2 
XB 5 107.8 8.5 20.4 26.8 21.0 23.8 19.8 9.8 121.6 


in the practical control of behavior the 
use of punishment is usually unneces- 
sary if the response in question is not 
strong to start with. Likewise, in clinical 
psychology, one is concerned over the 
“repression” of a response only if it is 
strong enough to be a source of conflict. 
At this point in the present investigation, 
however, it is necessary to determine 
whether the effects of punishment upon 
initially strong and initially weak re- 
sponses differ in kind or only in degree. 
The following experiment was designed 
to measure the effects of a period of 
severe punishment upon two responses 
which differ widely in amount of previ- 
ous positive reinforcement. 

Subjects and Procedure. The subjects 
were twelve female rats. After prelimi- 
nary conditioning they were divided into 
three’ groups of four rats each; then, 
Groups A and B were given one hour and 
Group C five hours of périodic reinforce- 
ment. On the first day of the experiment 
proper, all of the animals were placed 


from the effects of the punishment than 
Group C (Figure 8 and Table 6). Group 
A had recovered sufficiently by the second 
day of extinction so that the rate of 
responding differed little from that of 
the control group during the remainder 
of the experiment. Group C recovered 
somewhat more rapidly and during the 


_last three periods of extinction exhibited 


a compensatory increase in rate which 
partly made up the initial deficit caused 
by the punishment.* A comparison of 
these results with those of previous ex- 
periments indicates that the extent of 
later compensation for the initial depres- 
sion in rate of responding resulting from 
punishment is dependent upon both the 
conditions of punishment and _ the 
amount of previous positive reinforce- 


® The last three points on the curve of Group 
C would probably represent a compensatory in- 
crease even if compared with a control group 
which had also received five hours of periodic 
reinforcement. An unpublished study conducted 
by the writer indicates that such a control curve 
would not lie very far above Curve B. 


> | 
a= 
: 
= 


18 


WILLIAM K. ESTES 


Q 


A EXPER. 


(1 HOUR PER. REINF) 


\ GONTROL (1 HOUR PER. REINF) 
EXPER. (5 HOURS PER. REINF) 


RESPONSES 


PUN. 


! _2 3 4 


EXPERIMENTAL PERIODS 


Fic. 8. Effects of punishment as a function of 
initial strength of the response. Groups A and 
B had received one hour, Group C five hours, of 
periodic reinforcement prior to Day 1 (Experi- 
ment F). 


ment. The proportion by which the to- 
tal number of elicitations of the response 
necessary for extinction can be reduced 
by a given condition of punishment de- 
creases with increasing amounts of pre- 
vious periodic reinforcement. The 
/ greater the initial strength of a bit of 
behavior, the less effective is punishment 


as a means of controlling it. It appears 
likely that with sufficient periodic rein- 
forcement a strength of response could 
be achieved such that no period of con- 


*. tinuous punishment, regardless of dura- 
100 . tion or intensity, would affect the total 
- number of elicitations of the response 

~ | required for complete extinction. 


Conclusion. The extent to which the 
total number of unreinforced elicitations 
necessary for the complete extinction of 
a response can be reduced by punishment 
is a joint function of the amount of 
punishment and the amount of previous 
periodic reinforcement. With increasing 
amounts of periodic reinforcement, the 
resistance of a response to the effects of 
punishment probably increases more rap- 
idly than the resistance to extinction. 


Experiment G. Punishment of a Re- 
sponse After Establishment of a Dts- 
crimination 


Since the preceding experiment dem- 
onstrated that the course of recovery 
from punishment is a function of the 
initial strength of the response when 
differences in strength have been pro- 
duced by different amounts of periodic 
reinforcement, it is of interest to deter- 
mine whether the same relations hold 
when differences in initial strength result 


TABLE 6 
Mean periodic rates and extinction records for Experiment F 


Extinction Periods 


I 3 4 5 Tis 
(Pun.) 

XA 210.3 16.5 23.0 74.3 68.5 38.3 220.6 
XB 239.0 136.8 103.8 58.3 63.0 32.5 394.4 
Xe 291.8 44.3 75.0 84.8 88.5 80.5 373.0 
B-—A 
t 6.41 4-47 30 .18 -35 5.20 
Py .OOI .004 77 . 86 «92 .002 
t 2.25 4.30 1.08 -75 1.77 
Py .07 .005 -39 32 .48 .13 


|_| 
| \ 
| \ 
| 
| ye > \ 
| 


AN EXPERIMENTAL STUDY OF PUNISHMENT 19 


from the formation of a discrimination. 
The latter procedure should provide a 
rather delicate test of the relationship 
since it produces very low but stable 
states of strength. 

It has been shown by Skinner (42) 
that a stimulus which characteristically 
precedes reinforcement of a response be- 
comes an “occasion” for the occurrence 
of the response. For example, if a re- 
sponse is repeatedly reinforced when it 


1. After the establishment of a discrimina- 
tion, how will punishment administered in 
the absence of SP affect the strength of the 
response in its presence? 

2. Will recovery from punishment under 
the two stimulating conditions differ as 
should be expected according to the relation 
between initial strength of response and re- 
sistance to punishment formulated above 
(Experiment F)? 


Subjects and Procedure. The subjects 
were eight rats divided into an experi- 


TABLE 7 


Mean number of responses during silent intervals and intervals 
when the tone was sounding (Experiment G) 


Extinction Periods - 


N 
1: Pun. 2: Ext. 3: Ext 4: Ext 5: Ext 
SN SN S SN S$» 
Kr 5 5.4 44.2 28.2 16.2 12.6 33.6 9.3 23.6 
Xe 3 28.3 170.0 65.0 64.7 26.7 62.3 $3.3 33.0 
t 4.26 2.71 3-71 5§.81 1.62 1.85 1.47 .68 
Pr .005 .04 .OOI 15 .12 20 


occurs in the presence of a tone, but is 
never reinforced when the tone is absent, 
the response is gradually brought under 
the control of the tone (i.e., the tone be- 
comes a discriminative stimulus for the 
response). If we designate the discrimi- 
native stimulus as S”, the situation in the 
absence of SP as S‘, and the response as 
R, then during discriminative training 
the correlation SX - R decreases in strength 
while the correlation S”-R increases, and 
the organism comes to respond at a much 
higher rate when the tone is sounding 
than when it is not. After several periods 
of discriminative training, SN-R is vir- 
tually extinguished; S?-R remains at con- 
siderable strength, but is much more 
readily extinguished than a _ response 
which has been merely periodically rein- 
forced without differential correlation of 
the reinforcement with a discriminative 
stimulus. 

The present experiment was designed 
to answer the following questions: 


mental group of five rats and a control 
group of three. After preliminary train- 
ing, the animals were given eight experi- 
mental periods of discriminative train- 
ing under the following procedure. Every 
four minutes a tone was sounded in the 
experimental boxes; the next response to 
the lever released a pellet of food from 
the magazine and turned off the tone. Re- 
sponses occurring during the silent inter- 
vals were unreinforced. By the end of 
the eighth day under this procedure, the 
discrimination was well established, as 
indicated by reduced latencies of re- 
sponse after onset of the tone and low 
terminal rates of responding in the ab- 
sence of the tone (about 13 responses per 
hour per rat for the experimental group 
and 45 for the controls). After the com- 
pletion of discriminative training, the 
experimental rats were given ten minutes 
in the boxes with all responses punished 
while the controls were given ten min- 
utes of simple extinction. The tone was 
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not present for either group during this 
period. On the following day both groups 
were given one hour of extinction with- 
out the tone. During three further pe- 
riods of extinction, the tone was turned 
on for both groups according to the fol- 
lowing schedule. 


Second period..... the last 25 minutes, 
Third Period ..... the last 45 minutes, 
Fourth period ....the last 45 minutes. 

Le 

OF50 \ 

OBS. VALUES IN 

> ABSENCE OF TONE \ 

\ 

_ X# OBS. VALUES IN 

Z PRESENCE OF TONE 

oO \ 

CALC. VALUES IN 

S25 PRESENCE OF TONE x 
PUN: 
| 2 3 4 5 
EXPERIMENTAL PERIODS 


Fic. 9g. Recovery from punishment during silent 
intervals and intervals when the tone was sound- 
ing. The magnitude of p is an index of the 
current effect of punishment (Experiment G). 


Results. The results are summarized in. 


Table 7. The course of recovery from 
the effects of punishment is shown graph- 
ically in Figure g where the measure of 
the effect of punishment during each ex- 
perimental period is again taken as 


Xo — Xp 
Pt = 
Xo 


The solid line in Figure g represents the 


values of p for silent periods, while the 
broken line represents corresponding val- 
ues of p for intervals when the tone was 
sounding. 

The initial effect of punishment was 
apparently almost completely generalized 
from SN-R to S°-R; the magnitude of P 
for the first interval of extinction when 
the tone was sounding (on Day 3g in 
Figure g) was approximately equal to 
that for the first silent extinction period 
(Day 2 in Figure 9). 

The course of recovery from punish- 
ment was quite different for the two stim- 
ulating conditions. There was little re- 
covery in rate of responding in the ab- 
sence of S?. Recovery of strength in the 
presence of S?, however, followed a 
course similar to that observed in Ex- 
periment B. Theoretical values of p for 
intervals when the tone was sounding 
have been calculated from equation (A) 
of Experiment B, 


= 

with the magnitude of the constant of 
decrement e* taken as 0.6. There is fair 
correspondence of observed and calcu- 
lated values for the last two extinction 
periods; unfortunately, however, extinc- 
tion was not carried far enough to pro- 
vide an adequate test of the goodness of 
fit. On the last day of extinction, S?-R 
had completely recovered from the effect 
of punishment, while SY-R remained at 
a very low strength. 

Conclusion. After the establishment of 
a discrimination between two stimulat- 
ing conditions S? and SN, the initial ef- 
fect of a short period of severe punish- 
ment of the response in the absence of 
SP (i.e., condition S%) is almost com- 
pletely generalized to the strength of the 
response in the presence of S?. Recovery 
in strength of the connection S?-R fol- 
lows a course similar to that observed 
in the case of a response which had re- 
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ceived simple periodic reinforcement 
prior to punishment. The strength of 
S‘-R exhibits very little recovery from 
the effects of punishment. 


SECTION 2. CONFLICTING EFFECTS OF 
CONCOMITANT PUNISHMENT AND 
REWARD 


A comparison of the effects of punish- 
ment administered after the discontinu- 
ance of reinforcement with the effects of 
punishment administered while the re- 
sponse is still being periodically rein- 
forced is afforded by the two parts of 
Experiment B. On the first day of that ex- 
periment, one experimental Group (A) 
was given the usual periodic food rein- 
forcement for pressing the lever and in 
addition was punished for all responses; 
in the case of the other experimental 
group (C), food reinforcement was dis- 
continued while all responses were pun- 
ished; the control groups (B and D) re- 
ceived simple periodic reinforcement or 
extinction. The results of the two pro- 
cedures can be seen in Figure 3. It is clear 
that with the intensity and duration of 


punishment used in that experiment it_ 


makes little difference whether or not 


periodic positive reinforcement continues 


during the period of punishment. The 
extent of initial depression in strength of 
‘\\ response was approximately the same 
for the two procedures. Moreover, the 
_mathematical descriptions of the course 
_ of recovery from punishment in each in- 
stance indicates a similar form of the 
~process in the two cases. 

The course of recovery from punish- 
ment when the response continues to re- 
ceive periodic reinforcement after the 
discontinuation of punishment is investi- 
gated in the following experiment. This 
case is of particular practical interest be- 
cause punishment is most commonly re- 
sorted to as a means of influencing be- 
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havior when the factor of reward cannot 
easily be brought under control. 


Experiment H. The Acceleration of 
Recovery from Punishment by Posi- 
tive Reinforcement 


Subjects and Procedure. The subjects 
were five male rats. After preliminary 
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TIME (IN MINUTES) 
Fic. 10. Acceleration of recovery from punish- 
ment by positive reinforcement. Periodic food 


reinforcement at four minute intervals was given 
throughout the hour (Experiment H). 


6.0 


training the animals were subjected to 
the following procedure during a one- 
hour period. The control clock was set 
to reinforce single responses with food at 
four-minute intervals during the entire 
period (i.e., the usual procedure of pe- 
riodic reinforcement); from the fifteenth 
to the thirtieth minutes of the hour all 
responses were punished. 

Results. The effects of the punishment 
and the course of subsequent recovery 
are shown in Figure 10. The initial effect 
of punishment under periodic positive 
reinforcement is a sharp decline in rate 
of responding similar to that observed 
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in Part 1 of Experiment B. However, the 
recovery in strength following discon- 
tinuation of the punishment is greatly 
accelerated in the present experiment 
where the after-effects of the punishment 
are in conflict with continuing positive 
| eee, The amount of time sub- 


kK PUNA 


i 


RESPONSES k 1004 


TIME 


Fic. 10a. Reproduced from photostatic copies of 
the individual curves for the period which in- 
cluded the fifteen-minute interval of punish- 
ment (Experiment H), 


sequent to the termination of punish- 
ment required for the rate of responding 
to regain the level which obtained before 
punishment is, in this case, approxi- 
mately equal to the interval during 
which punishment was administered. 
An important property of punishment 
is revealed by the behavior during the 
interval when the response was both 
punished and periodically reinforced. 
The rate of responding dropped sharply 


to a low value, about one-tenth of its 
former magnitude,’ it then remained 
constant at this new low value until 
punishment was discontinued. The effect 
of punishment upon the periodic curve 
is simply a change in slope, in contrast to 
the negatively accelerated extinction 
curve which results from mere non-rein- 
forcement. Although Thorndike (48, 50) 
and many of his followers (e.g., 31, 34, | 
43) have frequently used the terms “pun- | 
ishment” and “non-reward” almost in- | 
terchangeably, it is clear that the two 
procedures may produce quite different 
effects upon the dynamic properties of 

In an earlier study reported by Skin- 
ner (42) a group of rats received periodic 
punishment (consisting of a slap to the 
forepaws administered by a “kick-back” 
of the lever) simultaneously with peri- 
odic food-reinforcement of a lever-press- 
ing response throughout several experi- 
mental periods. The result was a tem- 
porary reduction in_ periodic slope, 
followed by a return to the slope which 
had obtained under periodic food-rein- 
forcement alone. The differences between 
the results of Skinner’s experiment and 
the present one are probably due to dif- 
ferences in severity of punishment. In 
the former case, the punishment was 
mild and the animals quickly became 
adapted to it; in the latter, the punish- 
ment was severe enough so that little 
adaptation would be expected. 

The effects of punishment upon the 
strength of a response are very similar to 
in level of drive. Pun- 
ishment of a periodically reinforced re- 
sponse results simply in an adjustment 
of the rate of responding to a lower, but 
still constant, value which is determined 


*This effect can be seen most clearly in the 
individual curves of Figure 10a. 


AN EXPERIMENTAL STUDY OF PUNISHMENT 


jointly by the conditions of reinforce- 
ment and the severity of the punishment. 
Likewise during extinction, punishment 
produces a depression in strength of the 
response which is maintained so long as 
the effects of the punishment persist. 
However. progress toward complete elim- 
ination of the response is not accelerated 
while the strength is depressed because 
of punishment. 

Conclusion. Concomitant punishment 
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and reward of a response produce essen- 
tially the same changes in its dynamic 
properties as punishment after discon- 
tinuation of reward. The immediate ef- 


‘fect of punishment upon a periodically 


reinforced response is a change in slope 
similar to that effected by a change in 
level of drive. If reinforcement continues 
after the discontinuation of punishment, 
the effect of punishment is quickly dis- 
sipated. 
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III. ANALYSIS OF THE ACTION OF PUNISHMENT 


N ANY Situation involving punishment, 
I at least three principle variables can 
be distinguished: the response, R, dis- 
criminative stimuli for the response, S?, 
and a disturbing or traumatic stimulus, 
S’. The experiments reported in the 
earlier sections of this paper have, like 
most other psychological studies of pun- 
ishment, investigated only the correla- 
tion between S?’ and R or between S? 
and S°-R where the latter connection is 
taken as a unit. They have been con- 
cerned with punishment for doing some- 
thing, the implicit assumption being that 
the effects of punishment are entirely 
dependent upon the temporal contiguity 
of the punishment and a response, and 
upon the punishment’s being strictly 
contingent upon the occurrence of the 
response. In this chapter an attempt will 
be made to secure experimental confir- 
mation or refutation of these assump- 
tions. 


Experiment I. Effects upon Extinc- 
tion of a ‘Punishment’ not Directly 
Associated with the Response 


The following experiment investigates 
the effects upon a response of correlation 
of a disturbing stimulus with the dis- 
criminative stimuli® for the response. 

Subjects and Procedure. An experimen- 
tal and a control group, of four rats 
each, were subjected, after preliminary 
training, to the following procedure. 
Both groups were placed in the experi- 
mental boxes for a ten-minute period of 
extinction, during which the experimen- 
tal group received periodic shocks at in- 
tervals of approximately thirty seconds. 


SIn this experiment the discriminative stimuli 
are merely the stimuli which are normally pres- 
ent in the experimental situation and which, 
after initial conditioning, provide the ‘occasion’ 
for the occurrence of the response. 


Care was taken that the shock should not 
be given during or immediately follow- 
ing a response to the lever. Otherwise, 
the shocks were entirely uncorrelated 
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Fic. 11. Effects of periodic shocks upon extinc- 
tion. On the day of ‘punishment,’ the experi- 
mental animals were given a series of shocks 
which were not temporally contiguous with re- 
sponses to the lever (Experiment I). 


with the response during this period. Be- 
ginning on the following day, each group 
was given six one-hour periods of simple 
extinction. 

Results. A comparison of the extinc- 
tion curves for the experimental and con- 
trol groups of the present experiment 
(Figure 11) with the corresponding 
curves for Experiment B in which the 
experimental groups had received ten 
minutes of punishment (Figure 3) reveals 
a striking similarity between the effects 
of a negatively reinforcing stimulus 
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which is uncorrelated with the response 
and one whose administration is contin- 
gent upon the occurrence of the response. 
In other words, merely being shocked in 
the experimental situation apparently 
has the same effect upon the animals’ be- 
havior with respect to the lever as being 


punished for making the response. - 


A more precise comparison of the two 
experiments is afforded by the mathe- 
matical descriptions of recovery from 


of extinction is to be expected unless the 
number of subjects is very large because 
of the low terminal heights of the extinc- 
tion curves. That is, on the fifth or sixth 
day, a chance deviation of only a few 
responses has a disproportionately large 
effect upon the value of p. And both in 
this experiment and in Experiment B, 
deviations from the theoretical curve 
tend to counterbalance each other in di- 
rection. That is, a marked deviation be- 


TABLE 8 
Mean periodic rates and extinction records for Experiment I 


Extinction Periods 


N Pr. 
Pun I 2 3 4 5 6 Ti-6 
XE 4 266.3 66.5 ga.g 33.8 $3.3 335-1 
Xc 4 266.3 46.8 136.8 76.0 74.3 33-3 593-7 
t 2.33 2.11 1.64 1.30 1.26 18 =.83 2.41 
Pr .08 . ts 24 88 .30 05 


* Record for one rat during this period lost because of mechanical difficulty with the recorder. 


punishment in the two cases. In experi- 
ment B, it was found that recovery from 
punishment was described by an equa- 
tion of the form: 


P= Poe 
where p, is the magnitude of 


— 

Xo 
at the time t, p, is the value of p for the 
period of punishment, and a is a con- 
stant. In Figure 12, an equation of this 
form with | 


= -63 


a= .21 
has been fitted to the empirical values of 
p for the present experiment. The theo- 
retical curve provides a good fit to the 
empirical points for the first four days 
of extinction. The last two points deviate 
from the expected value, but an average 
of the two would fall approximately on 
the curve. As noted above (Experiment 
B) this increased scatter toward the end 


low the curve is followed by a com- 
pensatory rise above it. This phenome- 
non of compensation for deviations 
below a smooth curve representing the 
mean trend of a set of observed values 
has been frequently observed in connec- 
tion with extinction curves (42). In any 
case, the theoretical curve in Figure 12 
provides a satisfactory description of the 
trend of the observed points and the 
correspondence of calculated and ob- 
served values is probably better than 
could be obtained with any other simple 
mathematical function without increas- 
ing the number of arbitrary constants. 
Since the effect of a shock which im- 
mediately follows a response (a ‘punish- 
ment’) upon the dynamic properties of 
that response is satisfactorily described 
by the same mathematical function which 
most simply describes the effect of a shock 
which is independent of the response, 
the conclusion seems inescapable that at 
least a great part of the initial effect of 
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punishment is due simply to correlation 
of the negatively reinforcing stimulus 
with the mental situation, The im- 
portant correlation appears to be that 
between the shock and the stimuli which 
normally act as the occasion for the oc- 
currence of the response rather than be- 
tween the shock and the response per se. 

These results clearly confirm the con- 
tention of ‘Thorndike (50) that the action 
of punishment is not a direct ‘weakening’ 


to that produced by actual punishment 
of the response. 


Experiment J. Extinction of the Ef- 
fects of Punishment Without Elicita- 
tion of the Response 

The fact that little difference can be 
detected between the effects of a short 
period of punishment of a response and 
the effects of a comparable period during 
which the disturbing stimulus was ad- 
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-.5 0 
O 
LJ 
p29 
© 
<a 
A PU N. n L Xx 
2 3 4 6 
yp: EXPERIMENTAL PERIODS 
> Fic. 12. Recovery from the effects of ‘punishment’ which was not 


correlated with the response. The magnitude of p is an index of 
the current effect of the ‘punishment’ (Experiment 1). 


of the punished stimulus-response con- / ministered independently of the response 
nection. Rather it appears that some part | upon the course of subsequent extinc- 


of the reaction to punishment becomes tion, indicates that a great part of the 
conditioned to the same stimuli which initial effect of punishment is attributa- 


previously formed an occasion for the) 


occurrence of the punished response, and 
that the empirical points of Figures 4 and 
12 actually represent extinction curves 
for this conditioned reaction. 
Conclusion. The temporal contiguity 
of a disturbing stimulus and _ stimuli 
which normally act as an occasion for the 
occurrence of a response yields a depres- 
sion in rate of responding during subse- 
quent periods of extinction very similar 


ble to the conditioning of a state of an- 
ticipation of the shock to the experimen- 
tal situation and does not depend upon 
a close correlation of the shock with the 
response. If this interpretation is correct, 
it should be possible to extinguish the 
greater part of the effect of punishment, 
without elicitation of the response. The 
following experiment was designed to 
test this possibility by measuring the ef- 
fect upon the course of recovery from 
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punishment of the interpolation of a 
period of adaptation to the experimental 
situation between the period of punish- 
ment and the beginning of subsequent 
extinction. Part 1 of the experiment is 
purely exploratory; Part 2 is a replica- 
tion with larger groups of animals and 
a slightly modified procedure. 


Part 1 


Subjects and Procedure. The subjects 
were three groups of rats, each including 
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of the experiment proper are as follows: 
Group A 77.5 
Group B 88.0 
Group C 66.3 
The marked depression in rate of re- 
sponding during the first period of ex- 
tinction after punishment which was so 
clearly evident in Figure g is lacking in 


these data. All of the differences are sta- 
n_ 


tistically insignificant. Evidently the ef- 
fect of a short period of punishment was 


dispelled by a period of exposure to the / 


experimental situation. 


TABLE 9 
Summary of the procedure and quantitative results of Experiment J, Part 2 


Extinction Periods 


N Pr. 10 min. period Amt. 
Adapt. I 2 3 4 5 6 7 
Xa, 215.6 (Pun.) 6.0 None 23.2 20.0 29.4 21.4 20.0 41.0 38.8 


5 

3 222.0 (Shock) — None 
Kc, 6 176.7 (Ext.) 42.8 None 

6 

3 

5 


207.5 (Pun.) 4.0 1 hr. 
214.7 (Shock) — 1 hr. 
201.0 (Ext.) 20.2 1 hr. 


2 7 


99.8 $2.3 59.8 43.3 52. 57-7 64.2 
51.7 28.8 27.5 23.8 22.8 21.2 53.8 
48.0 65.3 37-3 22.7 23.0 30.3 84.3 
64.6 38.2 28.2 29.8 35.0 52.4 41.8 


two males and one female. After pre- 
liminary training, the animals were sub- 
jected to the following procedure. Dur- 


ing a ten-minute period in the experi-— 


mental boxes, Group A received simple 
extinction; Group B received extinction 
plus punishment for all responses; Group 
C was placed in the boxes with the levers 
removed, and shocks were administered 
at sixty second intervals. On the follow- 
ing day all nine animals were placed in 
the boxes for two hours with the levers 
retracted in order to permit adaptation 
of any “emotional” reaction to the exper- 
imental situation which had become con- 
ditioned as a result of the procedure of 
the preceding day. On the third day, the 
levers were returned to the boxes and 
each group was given an hour of extinc- 
tion. 

Results. The mean heights of the ex- 
tinction curves obtained on the third day 


Part 2 


Subjects and Procedure. Twenty-eight 
rats were first given the usual prelimi- 
nary conditioning and periodic reinforce- 
ment. The animals were then subdivided 
into six groups matched as closely as pos- 
sible on the basis of initial periodic rate 
and subjected to the following proced- 
ures during a ten-minute test period: 


Groups A, and A,: 
responses punished; 
Groups B, and B,: periodic shocks, at sixty 
second intervals with levers retracted; 
Groups C, and C,: extinction. 


extinction with all 


On the following day, Groups A,, B,, 
and C, remained in the living cages; 
Groups A,, B,, and C, were placed in 
the boxes with the levers retracted, for a 
one-hour period of adaptation. Begin- 
ning on the third day, each group re- 
ceived seven one-hour periods of extinc- 
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tion. The first six were on consecutive 
days; the seventh was delayed until a 
week after the sixth in order to permit 
spontaneous recovery from extinction. 
The number of rats in each group is 
given in Table g, along with a summary 
of the procedure and the quantitative re- 
sults. 

Results. A comparison of the two sets 
of curves in Figure 13° indicates that the 
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Fic. 13. Effects of a period of adaptation upon 
the course of recovery from punishment. During 
the period of ‘punishment,’ Groups A, and A, 
were punished for responding, Groups B, and B, 
received random shocks, Groups Cy and C, re- 
ceived simple extinction (Experiment J). 


effect of the period of adaptation was an 
almost complete extinction of the ef- 
fects of punishment. The results of pun- 
ishment without adaptation, shown in 


This experiment was conducted during the 
summer at a time when day to day tempera- 
ture variations were unusually great. The re- 
sulting irregularity of the extinction curves pre- 
cludes a very detailed analysis of the data. The 
general result, however, may be accepted with 
confidence, since the two parts of the experi- 
ment are in complete agreement. Also, the con- 
clusions drawn from these experiments will be 
subjected to an additional check in Experiment 
K 


the upper panel of Figure 13, agree with 
those of earlier experiments (B, C, I) in 
showing a rather persistent depression in 
rate of responding during extinction. 
When an hour of adaptation is interpo- 
lated between punishment and extinc- 
tion, however, the extinction curves of 
the three groups do not differ significant- 
ly (lower panel of Figure 19). 

When extinction begins immediately, 
the group which had received periodic 
shocks exhibits a more prolonged depres- 
sion in rate of responding than the group 
which had received punishment for re- 
sponding; however, more complete re- 
covery is effected after a period of adap- 
tation in the boxes for the animals which 
received periodic shocks than for those 
which were punished. Therefore, it ap- 
pears that not quite all of the effect of 
actual punishment is attributable merely 
to the correlation of the disturbing stim- 
ulus with the general stimulation from 
the experimental situation. The essential 
difference between the two procedures 
may lie mainly in the fact that when the 
shock is closely correlated with the re- 
sponse, the ‘anticipatory’ reaction to 
shock may be conditioned to tactual 
stimulation from the lever and the pro- 
prioceptive stimulation from the move- 
ments involved in pressing the lever as 
well as to general stimulation from the 
experimental situation. During the peri- 
od of adaptation, then, only the latter 
connections are extinguished. Condition- 
ing to specific stimulation from the lever 
cannot be extinguished until subsequent 
extinction, involving repeated elicitation 
of the response, is carried out. The re- 
sults of the present experiment indicate, 
however, that during a short period of 
severe punishment, the conditioning of 
the reaction to punishment tends to be 
rather generalized to the whole complex 
of stimuli acting at the time and that 
little specific connection between the 
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punishment and the response is estab- 
lished. Of course it does not follow from 
the results of this experiment that the 
correlation of punishment with the pun- 
ished response is unimportant. Experi- 
ment K will investigate conditions under 
which a closer connection between the 
effect of punishment and the punished 
response can be established. 
Conclusion. The effects of a short 
period of severe punishment upon the 
dynamic properties of a response are al- 
most completely dispelled by a period 


\ during which the organism is exposed 
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punishment. In view of the results of Ex- 
periments I and J, it is possible that the 
greater persistence of the effect of peri- 
odic punishment may be due to the 
greater opportunity afforded for strong 
conditioning of part of the reaction to 
the disturbing stimulus to tactual stimu- 
lation from the lever and to propriocep- 
tive stimulation from the movements in- 
volved in pressing the lever. (It has been 
well established (42) that periodic rein- 
forcement of a response produces much 
greater resistance to extinction than con- 
tinuous reinforcement.) If this interpre- 


TABLE 10 
Mean periodic rates and extinction records for Experiment K 


Raw Data Data Corrected for Periodic Rate 
N Pr. Pun. Extinction Periods . Extinction Periods 
un 

I 2 3 4 5 6 I 2 3 4 5 6 
XA 6 265.2 37.5 24.5 26.97 26.3 48.2 19.7 66.9 36.3 «18.0 33. 36.3 
XB 6 223.3 16.5 50.8 64.7 30.5 87.2 30.2 40.0 24.2 76.9 2553 $3.7 56.0 
Xc 6 448.0 158.0 118.5 78.3 88.0 49.3 59.2 45.2 95.§ 60.7 Go.8 43.5 24.0 36.38° 24.8 
A-B 
t 2.02 2.07 1.33 -49 1.60 2.79 1.47 1.06 -99 1.04 
Pt .07 .06 -20 86.64 .48 .02 -35 ~32 
A-C 
t 1.34 8:09 8.67 .82 2.58 1.98 -48 -76 -20 -92 
Pt .62 .31 .03 08 .99 «4.46 .85 
B-—C 
t 1.44 1.096 -89 8.56 .85 1.00 .67 3.86 $7 17.83 
Pt -18 08 -39 -59 .84 .003 -59 .48 .88 .10 


to the experimental situation but is un- 
able to make the response. The interpre- 
tation of punishment as a process of sup- 
pression rather than extinction of the 
response is substantiated by the present 
demonstration that the principal effects 
of a short period of punishment can be 
conditioned or extinguished quite inde- 


pendently of the elicitation of the re- 


sponse. 


Experiment K. Periodic and Continu- 
ous Punishment Compared with Re- 
spect to the Specificity of their Effects 
to the Punished Response 


In an earlier experiment (Experiment 
E) it was shown that the effects of peri- 
odic punishment tend to be more per- 


sistent than the effects of continuots - 


tation is correct, then the interpolation 
between the period of punishment and 
the beginning of subsequent extinction 
of a period of adaptation to the general 
stimulation of the experimental situa- 
tion should be expected to increase the 
disparity between the effects of the two 
procedures of punishment. 

Subjects and Procedure. The eighteen 
rats serving as subjects in this experi- 
ment were divided after preliminary 
training into one control and two experi- 
mental groups of six rats each. On the 
first day of the experiment all three 
groups were placed in the experimental 
boxes for a forty-minute period during 
which Group C received extinction, 
Group B, extinction plus punishment for 
all responses, and Group A, extinction 
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plus periodic punishment. Under the lat- 
ter procedure, the condensors were con- 
nected in circuit with the levers for one 
minute out of every four, during which 
all responses were punished; during the 
intervening intervals responses were 
neither punished nor reinforced. On the 
following two days, all groups were 
placed in the boxes for one-hour periods 
with the levers retracted. Beginning on 
the fourth day, each group received six 
one-hour periods of extinction. 


pression in rate of responding during the 
period of punishment. After the two 
periods of adaptation to the experimental 
situation, however, the effects of the pun- 
ishment had been almost completely dis- 
pelled, as indicated by the fact that the 
curve of Group B (Figure 14) nearly re- 
joins the control curve on the first day 
of extinction. The group which received 
periodic punishment (Group A), showed 
less initial effect of punishment, but ex- 
hibited little recovery from the punish- 
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Fic. 14. Effects of a period of adaptation upon recovery from pe- 
riodic as compared to continuous punishment mean curves corre- 
lated for periodic rate. (Experiment K). 


Results. The quantitative results of 
this experiment are summarized in Table 
10. Since Group C has a disproportion- 
ately high periodic rate, all comparisons 
are made both for the raw data and for 
data corrected for differences in motiva- 
tional level. Although the results are not 
greatly different with or without the cor- 
rection for motivational level, the cor- 
rected data probably give a truer picture 
of the influence of the variables under 
consideration. 

Group B, which received continuous 
punishment on the first day of the experi- 
ment proper, exhibited the greater de- 


ment on the first day of extinction indi- 
cating that the effects of periodic punish- 
ment are more closely associated with the 
punished response than those of continu- 
ous punishment. 

Conclusion. The results of this experi- 
ment, with those of Experiment E, show 
that while continuous punishment of a 
response produces greater initial depres- 
sion in strength, periodic punishment re- 
sults in a more persistent inhibitory effect 
during subsequent extinction. The ef- 
fects of periodic punishment are more 
specific to the punished response than 
those of continuous punishment. 
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IV. INDUCTION OF PUNISHMENT BETWEEN DYNAMICALLY 
RELATED RESPONSES 


HE PRECEDING experiments have in- 
pene the principles governing 
the effects of punishment upon a single 
isolated response. Now, it is of interest 
to determine whether or not additional 
principles will be required to account for 
the action of punishment in a more com- 
plex case involving more than one re- 


sponse. The greatest part of the litera- 


ture on experimental studies of punish- 
ment has been concerned with situations 
in which two alternative responses are 
available, one of which is arbitrarily con- 
sidered ‘right’ and the other ‘wrong’, for 
example, studies of the effect of punish- 
ment for ‘errors’ in maze learning. It is 
likely that the apparently conflicting re- 
sults of many of these studies (see, for 
example, 6, 52) on the question of the 
effectiveness of punishment are due to 
the fact that the experiments have typi- 
cally been set up merely to determine 
which of two alternative responses is 
‘learned’ rather than to trace the changes 
in strength of each response resulting 
from the punishment. In the following 
experiment the animals first learned to 
press two different levers for food rein- 
forcement, then one response was pun- 
ished, and the resulting changes in 
strength of both were traced through sub- 
sequent periods of extinction. 


Experiment L. Effects of Punishment 
in a Situation Involving More Than 
One Response 


Subjects and Procedure. The subjects 
were two groups of four rats. The ap- 
paratus was the same as that used in pre- 
ceding experiments except for the addi- 
tion of a second lever. The two levers 
were about two inches apart on one wall 
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of the experimental box, one situated to 
the left and one to the right of the food 
tray. Both levers were retractable so that 
either could be presented alone. After 
preliminary conditioning, each rat was 
given two hours of periodic reinforce- 
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Fic. 15. Effects of punishment in a situation in- 
volving alternative responses. Prior to Day 1, 
each group had received periodic reinforcement 
on both levers, then punishment on the left 
lever. The corrected curve for Group B has been 
multiplied through by a constant chosen to 
equate the two groups for periodic rate, Uncor- 


rected values for Group B are indicated by the 
open circles (Experiment L). 


ment on each lever. Since the mean rates 
of responding under periodic reinforce- 
ment were 152.0 responses on the left 
lever and 150.4 on the right lever, it can 
safely be assumed that the strengths of 
the two responses were equal. The re- 
mainder of the experiment was carried 
out according to the following schedule: 


Me 
| 
B CORR. ° \ 
° ° : 


32 WILLIAM 
Group 10 min. Four ex- Fifth ex- 
pun. tinction tinction 
periods period 
A Left Right lever Left lever 
lever 
B Left Left lever Right lever 
lever 


Results. The results of the experiment 
are presented in Figure 15 and Table 11. 
Records corrected for differences in ini- 
tial periodic rate are included along with 
the raw data in both cases. A comparison 
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on the fourth and fifth days for the two 
groups yields a value of “t’” which would 
occur only four times in a hundred in a 
chance distribution. An X? test applied 
to the mean rates on the same two days 
yields a value of X? which would occur 
less than one time in a thousand in a 
chance distribution. The result is the 
same for the data corrected for initial 
periodic rate as for the raw data. 


TABLE 11 
Mean periodic rates and extinction records for Experiment L 


Extinction Period 


N Pr. 
I 2 3 4 5 Ds-s 
Raw Data 
R R R R L 
KA 4 220.3 22.5 46.0 47.3 67.8 48.3 +19.5 
L i. L L R 
XB 4 134.9 20.8 18.3 17.0 24.8 65.3 —40.5 
t 1.95 .12 1.30 1.4! 1.10 2.58 
Pr .10 21 31 .63 .04 
Corrected for Periodic Rate 
R R R R 
EA 4 220.3 22.5 46.0 47.3 67.8 48.3 +19.5 
L L R 
ip 4 220.3 33-9 29.8 $7.7 40.4 106.4 —66.0 


of the heights of the twocurves on the fir:t 
day in Figure 15 indicates that the initial 
effect of punishment is completely gen- 
eralized to the unpunished response. The 
course of recovery during the next three 
periods is quite different for the two re- 
sponses, however, being considerably ac- 
celerated for the unpunished response, 
Rg. On the fifth day of extinction, when. 
the previously retracted lever was pre- 
sented to each group, the result was a 
sharp rise in rate of responding for 
Group B which had been receiving ex- 
tinction on the punished response, Ry, 
and a sharp decline in rate for Group 
A which had been receiving extinction 
on the unpunished response, Rg. A com- 
parison of the differences between rates 


Two relatively distinct effects of pun- 
ishment can be distinguished. The first 
is not specific to the punished response 
but affects to about the same extent any 
behavior which would normally occur in 
the situation in which the punishment 
was administered. In this experiment, 
the punishment initially affected the two 
responses equally. But the subsequent 
course of recovery, and the marked 
changes in strength when the previously 
retracted levers were presented on the 
fifth day of extinction, show that a part 
of the effect of punishment is quite spe- 
cific to the punished response. The re- 
covery in strength of Rp during the first 
four days of extinction in the case of 
Group A together with the sharp rise in 
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rate of responding for Group B on the 
fifth day when the right lever was pre- 
sented for the first time during extinc- 
tion, show that the generalized effect of 
punishment upon R,z adapts out at about 
the same rate during subsequent periods 
in the experimental situation whether 
the response is elicited or not. On the 
other hand, the drop in the curve of 
Group A on the fifth day demonstrates 
that part of the effect of punishment is 
specific to the punished response and 
cannot be extinguished without unpun- 
ished elicitations of that response. It 
appears, then, that the effects of punish- 
ment in this situation can be completely 
accounted for by the principles devel- 
oped in Chapters II and III. 

Conclusion. If of two equally strong 
responses, R, and R,, which have pre- 
viously been reinforced in a given situa- 
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tion one, R,, is punished to the point of 
temporary suppression, the initial effect 
of the punishment is completely general- 
ized to R,. During subsequent periods 
of extinction, the recovery of R, from 
the effects of punishment is considerably 
accelerated over that of R, and appears 
to proceed at about the same rate during 
periods of exposure to the experimental 
situation whether R, is actually elicited 
or not. As for the effect of punishment 
upon the punished response itself, the 
results of this experiment confirm the 
conclusion drawn from Experiment J— 
that partial recovery from punishment 
occurs during subsequent periods of pas- 
sive exposure to the experimental situa- 
tion but that complete recovery is con- 
tingent upon a sufficient number of ac- 
tual elicitations of the response. 
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V. SUMMARY OF EMPIRICAL PRINCIPLES 


I. 


HEN the disturbing stimulus is of 
Wonticien: intensity and is tempo- 
rarily contiguous with a response and 
with the discriminative stimuli for the 
response, the immediate effect of punish- 
ment is regularly a depression in strength 
of the response. This effect is maintained 
so long as the punishment continues to 
be correlated with the response. How- 
ever, the rate of responding at the end 
of a period of punishment, regardless of 
severity or duration, is not a reliable in- 
dex of the true latent strength of the 
response. Discontinuation of punishment 
is always followed by some recovery in 
strength. 

Il. 

The effects of punishment are contin- 
gent upon a close association of the dis- 
turbing stimulus with the stimuli which 
normally provide an occasion for the 
occurrence of the response (discrimina- 
tive stimuli). There is no evidence that 
the correlation of the punishment with 
the response per se in the role of a ‘nega- 
tive reinforcement’ is important. 


Ill. 

The extinction of a response which 
has been positively reinforced cannot be 
accelerated by the application of punish- 
ment; the total amount of time neces- 
sary for extinction is evidently deter- 
mined by the conditions of previous posi- 
tive reinforcement and cannot be re- 
duced by punishment. 


IV. 

The extent to which the total number 
of unreinforced elicitations of a response 
necessary for extinction at a given level 
of drive can be reduced by punishment 
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is a joint function of the conditions of 
punishment and the conditions of pre- 
vious positive reinforcement. 

A. When a response which has been 
strengthened by periodic reinforcement 
is punished for a time and then during 
subsequent periods is neither punished 
nor reinforced, the following relation- 
ships hold: 

1. A period of mild punishment pro- 
duces a temporary depression in rate of 
responding which is followed by a com- 
pensatory increase so that the total num- 
ber of unreinforced elicitations necessary 
for complete extinction is not altered. 

2. When a severe punishment is con- 
tinued to the point of temporary suppres- 
sion of the response, the process of re- 
covery from the initially depressing ef- 
fect of the punishment is described by 
an equation of the form 


Pt p.e* 


where p, is an index of the effect of 
punishment remaining at time t, p, is the 
magnitude of p during the period of 
punishment, and a is a constant. After 
recovery from the effects of punishment, 
there is only partial compensation for the 
previously depressed rate of responding. 

3. When severe punishment is_pro- 
longed beyond the point of temporary 
inhibition, a considerable saving may be 
effected in the total number of unrein- 
forced elicitations of the response neces- 
sary for extinction. 

B. The proportion by which the total 
number of unreinforced elicitations of 
the response necessary for extinction can 
be reduced by a given condition of pun- 
ishment decreases with increasing 
amounts of previous positive reinforce- 
ment. 
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V. 


After the establishment of a discrimi- 
nation, the initial effect of punishment 
of the response in the absence of the dis- 
criminative stimulus (the stimulus which 
provides the occasion on which the re- 
sponse will be reinforced) is almost com- 
pletely generalized to the strength of the 
response in its presence. Recovery in 
strength of the response in the presence 
of the discriminative stimulus follows a 
course similar to that observed in the 
case of a response which was simply peri- 
odically reinforced for a time prior to the 
period of punishment. The strength of 
the response in the absence of the dis- 
criminative stimulus exhibits little re- 
covery from the effects of punishment. 


VI. 


The immediate effect of punishment 
upon a periodically reinforced response 
is a simple change in slope of the peri- 
odic curve (i.e., a decline in strength); 
if reinforcement continues after the dis- 
continuation of punishment, the effects 
of punishment are quickly dissipated. 
The effects of punishment of a response 
upon the course of subsequent extinc- 
tion are about the same whether or not 
positive reinforcement continues during 
the period of punishment. 


Vil. 


The result of a period during which 
a disturbing stimulus is associated with 
the stimuli which normally act as an 
occasion for the occurrence of the re- 
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sponse is a depression in strength of the 
response during subsequent periods of 
extinction very similar to that produced 
by a period of actual punishment of the 
response. 


Vill. 


The effects of a period of severe pun- 
ishment are almost completely extin- 
guished by a period during which the 
organism is exposed to the experimental 
situation but is unable to make the re- 
sponse. 

IX. 


The effects of periodically adminis- 
tered punishment are more specific to the 
punished response than those of punish- 
ment which follows every occurrence of 
the response. 


X. 


If of two alternative responses to a 
situation, R, and R,, which are initially 
of equal strength, one, R,, is punished, 
the initial effect of punishment is com- 
pletely generalized to R,. During subse- 
quent periods, the recovery of R, from 
the effect of punishment is considerably 
accelerated over that of R, and proceeds 
at about the same rate during periods of 
exposure to the experimental situation 
whether R, is actually elicited or not. As 
for the recovery from punishment of the 
punished response, R,, it appears that 
partial recovery occurs during periods of 
passive exposure to the experimental sit- 
uation, but complete recovery is contin- 
gent upon a sufficient number of actual 
elicitations of the response. 
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VI. THEORETICAL AND PRACTICAL IMPLICATIONS 


AN INTERPRETATION OF PUNISHMENT IN 
TERMS OF EMOTIONAL CONDITIONING 
AND CONFLICT 


HE RESULTS of the present investiga- 
ype tend, in general, to confirm 
Thorndike’s most recent formulation of 
the law of effect (50). It appears that the 
effects of punishment upon the punished 
response are due to competing reactions 
aroused by the noxious stimulus. No evi- 
dence has been forthcoming to indicate 
that punishment exerts a direct weaken- 
ing effect upon a response comparable to 
the strengthening produced by a reward. 
The term ‘reinforcement’ can best be re- 
served for the latter class of stimuli. 

The observed facts concerning the ac- 
tion of punishment can be accounted for 
in terms of conditioning principles estab- 
lished by investigations of the effects of 
a noxious stimulus which is not corre- 
lated with a response in the role of a 
punishment. An experiment reported by 
Estes and Skinner (18) demonstrated that 
a tone which precedes a disturbing stimu- 
lus acquires the capacity to depress the 
strength of behavior normally occurring 
in the situation even though the behavior 
has never been directly associated with 
either stimulus. It was concluded that the 
tone becomes an occasion (a conditioned 
stimulus) for a state of ‘anxiety’ or an- 
ticipation of the shocks. 

In an earlier investigation, Warner 
(58) subjected rats to repeated presenta- 
tions of a CS (buzzer or light) followed 
by shock, under a variety of conditions 
and observed the reaction to the buzzer 
or light resulting from the conditioning. 
He found that no specific parts of the 
original response to the US, with the 
possible exception of autonomic reac- 
tions, such as change in breathing rate, 


are regularly conditioned. About all that 
can be said with confidence about the 
conditioned state of anticipation which 
comes to be aroused by a stimulus (S,) 
which characteristically precedes a dis- 
turbing stimulus (S,), is that it commonly 
involves parts of the original uncondi- 
tioned reaction to S, together with some 
apparently random activity, and that it 
results in the disruption of the ‘normal’ 
behavior of the organism, in the situa- 
tion in question so long as S, is present. 

It is clear, then, that a disturbing or 
traumatic stimulus arouses a changed 
state of the organism of the sort common- 
ly termed ‘emotional’ and that any stim- 
ulus present simultaneously with the dis- 
turbing stimulus becomes a conditioned 
stimulus capable of itself arousing the 
state on subsequent occasions. From the 
results of the present investigation, we 
may conclude that a great part of the 
initial effect of punishment is due to this 
sort of emotional conditioning. In Ex- 
periment G, in which the rats were mere- 
ly given shocks while in the experimental 
situation, the stimuli which normally 
provided an occasion for the occurrence 
of the lever-pressing response became 
conditioned stimuli for anticipating 
the shock. When punishment is corre- 
lated with the response, emotional reac- 
tion can also become conditioned to the 
incipient movements of making the re- 
sponse. (This interpretation has been 
anticipated by Skinner [42].) During peri- 
ods following discontinuation of punish- 
ment when the organism is exposed to 
the situation in which punishment oc- 
curred but is unable to make the re- 
sponse, the connections between the con- 
ditioned emotional state and the stimuli 
present in the situation are extinguished. 
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In addition to a generalized emotional 
reaction, a disturbing stimulus usually 
arouses a withdrawal response, RW. It 
has been shown (9, 25, 26) that RW be- 
comes conditioned to any stimulus which 
is contiguous with the disturbing stim- 
ulus. In many situations involving pun- 
ishment there is opportunity for RW to 
become conditioned to the same stimuli 
which previously aroused the punished 
response. Part of the effect of punish- 
ment in these cases is probably a result 
of conflict between the competing re- 
sponses. If the disturbing stimulus is of 
sufficient intensity, RY becomes prepo- 
tent and the original response temporari- 
ly ceases to occur. When a child touches 
a hot radiator, for example, the painful 
stimulation causes a vigorous withdrawal 
from the hot object. On subsequent oc- 
casions, the sight of the radiator alone 


will suffice to arouse the withdrawal re- 


sponse which, being directly in conflict 
with the response of touching the radia- 
tor, prevents the occurrence of the latter. 
However, the present investigation has 
demonstrated that the original response 
is not eliminated from the organism’s 
repertoire, but continues to exist at a 
state of considerable latent strength. 
Whenever punishment is discontinued, 
experimental extinction of RW begins; 
and as R™ is weakened, the original re- 
sponse recovers in strength, It is likely 
that the superiority of periodically ad- 
ministered punishment over punishment 
which follows every occurrence of a re- 
sponse (noted in Experiments E and K) 
is due to the resulting periodic reinforce- 
ment of the response of withdrawal from 
the region of the lever. Skinner (42) has 
shown that periodic positive reinforce- 
ment of a response produces much great- 
er resistance to extinction than continu- 
ous reinforcement. In this situation, 
termination of the shock presumably acts 
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as reinforcement for the response of 
withdrawal from the lever. 

The generalized effects of punishment 
are probably mediated largely by the 
‘emotional’ reaction aroused by the 
noxious stimulus. This reaction should 
be expected to affect any behavior nor- 
mally occurring in the situation and ac- 
counts for the initially complete induc- 
tion of the effects of punishment between 
dynamically related responses noted in 
Chapter IV. During a period of adapta- 
tion to the situation in which punish- 
ment occurred, the connections of the 
conditioned emotional state to the gen- 
eral stimulation from the experimental 
situation and to stimuli produced by 
movements of making the response are 
extinguished, the former directly, the 
latter through induction. 


PUNISHMENT IN THE PRACTICAL 
CONTROL OF BEHAVIOR 


Probably the most important practical 
implication of the present study is the 
demonstration that a response cannot be 
eliminated from an organism’s reper- 
toire more rapidly with the aid of pun- 
ishment than without it. In fact, severe 
punishment may have precisely the op- 
posite effect. A response can be perma- 
nently weakened only by a sufficient num- 
ber of unreinforced elicitations and this 
process of extinction cannot proceed 
while a response is suppressed as a result 
of punishment. The punished response 
continues to exist in the organism’s reper- 
toire with most of its original latent 
strength. While it is suppressed, the re- 
sponse is not only protected from ex- 
tinction, but it also may become a source 
of conflict. An emotional state, such as 
‘anxiety’ or ‘dread’, which has become 
conditioned to the incipient movements 
of making the response will be aroused 
by any stimuli which formerly acted as 
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occasions for the occurrence of the re- 
sponse. 

Another disadvantage of severe pun- 
ishment lies in the generalization of the 
conditioned emotional reaction aroused 
by the disturbing stimulus to other stim- 
uli acting at the time. Whipping a dog, 
for example, is quite as likely to result 
in the conditioning of fear and with- 
drawal reactions to the sight of the train- 
er as in the weakening of the undesired 
behavior. And the emotional state is as 
effective in depressing the strength of 
other behavior which would normally 
occur in the situation in question as in 
depressing the strength of the punished 
response. 

Punishment can be used profitably as 
an aid in the elimination of an undesired 
response only if the severity of the pun- 
ishment is adjusted in such a manner 
that the response continues to occur, but 
at a reduced rate; under this condition, 
a considerable saving may be effected in 
the number of unreinforced elicitations 
of the response necessary for extinction, 
although the total amount of time re- 
quired cannot be reduced. 

In cases where the factor of reward 
cannot be brought under control, pun- 
ishment of suitable intensity can be used 
to hold the response at a low strength, 
provided that the correlation of punish- 
ment with the response can be main- 
tained indefinitely. It was shown in 
Chapter II, Section 2, that the result of 
directly opposed punishment and reward 
is an equilibrium with the resultant 
strength of the response a function of 


the relative intensities of the two factors. 
For any given condition of reinforce- 
ment, a condition of punishment can 
probably be found that will reduce the 
rate of responding to a very low value. 
The principle difficulty with this pro- 
cedure is that whenever punishment 
ceases to be correlated with the response, 
the effects of the punishment are quick- 
ly dissipated. 

In many instances one is interested not 
so much in actually eliminating a re- 
sponse as in supplanting an undesired 
response to a situation with a more ac- 
ceptable one. Punishment can be useful- 
ly employed as a means of temporarily 
suppressing the original response while 
some other response is strengthened by 
reinforcement. 

In all of these cases, punishment can 
be expected to weaken a response only 
if it is temporally contiguous with the 
discriminative stimuli for the response 
and with the movement involved in mak- 
ing it, or with both. Many a dog-owner 
has learned the futility of attempting to 
break the habit of chasing cars by pun- 
ishing the animal when he returns from 
the chase and the car is out of sight. Edu- 
cators and animal trainers have frequent- 
ly observed that punishment is usually 
ineffective if delayed too long after the 
occurrence of the response. However, 
the present study has shown that it is 
not the correlation of the punishment 
with the response per se that is impor- 
tant, but the contiguity of the punish- 
ment with the stimuli which formerly 
aroused the response. 
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